Systems and methods for processing electronic medical images to determine enhanced electronic medical images

ABSTRACT

Systems and methods for processing electronic images from a medical device comprise receiving an image frame from the medical device, and determining a first color channel and a second color channel in the image frame. A location of an electromagnetic beam halo may be identified by comparing the first color channel and second color channel. Edges of an electromagnetic beam may be determined based on the electromagnetic beam halo, and size metrics of the electromagnetic beam may be determined based on the edges of the electromagnetic beam. A visual indicator on the image frame may be displayed based on the size metrics of the electromagnetic beam.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims the benefit of priority from U.S. ProvisionalApplication No. 62/936,947, filed on Nov. 18, 2019, which isincorporated by reference herein in its entirety.

TECHNICAL FIELD

Various aspects of the present disclosure relate generally to systemsand methods useful in planning and/or performing medical procedures.

BACKGROUND

Substantial progress has been made towards increasing the effectivenessof medical treatment while reducing trauma and risks to the patient.Many procedures that once required open surgery now may be done withless invasive techniques, thus providing for less recovery time andrisks of infection for the patient. Certain procedures requiring biopsy,electro-stimulation, tissue ablation, or removal of native or foreignbodies may be performed through minimally-invasive surgery.

In the field of urology, for example, renal calculi or kidney stones canaccumulate in the urinary tract and become lodged in the kidney. Kidneystones are deposits of materials from the urine, typically minerals andacid salts. While smaller stones may pass from the body naturally,larger stones can require surgical intervention for removal. While opensurgery was once the standard treatment for the removal of stones, otherless invasive techniques, such as ureteroscopy and percutaneousnephrolithotomy/nephrolithotripsy (PCNL), have emerged as safer,effective alternatives. Additionally, advances in imaging technologyhave improved a medical professional's ability to identify and locatestones before and during procedures. Nevertheless, medical professionalsstill must analyze images to determine the location and size of stonesand whether any stones are present. Moreover, the images are oftenobstructed, blurry, and/or otherwise difficult to evaluate, making themedical professional's task of discerning the presence or size of anystones challenging.

The systems, devices, and methods of the current disclosure may rectifysome of the deficiencies described above, and/or address other aspectsof the prior art.

SUMMARY

Examples of the present disclosure relate to, among other things,medical systems and methods. Each of the examples disclosed herein mayinclude one or more of the features described in connection with any ofthe other disclosed examples.

In one example, the present disclosure includes a method for processingelectronic images from a medical device comprising receiving an imageframe from the medical device, and determining a first color channel anda second color channel in the image frame. A location of anelectromagnetic beam halo may be identified by comparing the first colorchannel and second color channel. Edges of an electromagnetic beam maybe determined based on the electromagnetic beam halo, and size metricsof the electromagnetic beam may be determined based on the edges of theelectromagnetic beam. A visual indicator on the image frame may bedisplayed based on the size metrics of the electromagnetic beam.

In another example, the present disclosure includes a system forprocessing electronic images from a medical device, the systemcomprising at least one data storage device storing instructions forprocessing electronic images, and at least one processor configured toexecute the instructions to perform operations for processing electronicimages. The operations may comprise processing electronic images from amedical device comprising receiving an image frame from the medicaldevice, and determining a first color channel and a second color channelin the image frame. A location of an electromagnetic beam halo may beidentified by comparing the first color channel and second colorchannel. Edges of an electromagnetic beam may be determined based on theelectromagnetic beam halo, and size metrics of the electromagnetic beammay be determined based on the edges of the electromagnetic beam. Avisual indicator on the image frame may be displayed based on the sizemetrics of the electromagnetic beam.

In another example, the present disclosure includes a non-transitorycomputer-readable medium storing instructions that, when executed by acomputer, cause the computer to perform operations for processingelectronic images from a medical device. The operations may compriseprocessing electronic images from a medical device comprising receivingan image frame from the medical device, and determining a first colorchannel and a second color channel in the image frame. A location of anelectromagnetic beam halo may be identified by comparing the first colorchannel and second color channel. Edges of an electromagnetic beam maybe determined based on the electromagnetic beam halo, and size metricsof the electromagnetic beam may be determined based on the edges of theelectromagnetic beam. A visual indicator on the image frame may bedisplayed based on the size metrics of the electromagnetic beam.

BRIEF DESCRIPTION OF THE FIGURES

The accompanying drawings, which are incorporated in and constitute apart of this specification, illustrate various exemplary embodiments andtogether with the description, serve to explain the principles of thedisclosure.

FIG. 1 illustrates a medical system, according to aspects of the presentdisclosure.

FIG. 2 is a flow diagram of an exemplary method for processing medicalimages, according to aspects of the present disclosure.

FIG. 3 is a flow diagram of an exemplary method for determining a sizeof an object in medical images, according to aspects of the presentdisclosure.

FIG. 4 is a flow diagram of an exemplary method for medical imageenhancement, according to aspects of the present disclosure.

FIG. 5 illustrates an exemplary system that may be used in accordancewith techniques discussed in FIGS. 1-4, according to aspects of thepresent disclosure.

DETAILED DESCRIPTION

Examples of the present disclosure include systems and methods tofacilitate, and improve the efficiency and safety of minimally-invasivesurgeries. For example, aspects of the present disclosure may provide auser (e.g., a physician, medical technician, or other medical serviceprovider) with the ability to more easily identify, size, and, thus,remove kidney stones or other material from a patient's kidney or otherorgan. In some embodiments, for example, the present disclosure may beused in planning and/or performing a flexible ureteroscope procedure,with or without laser lithotripsy. Techniques discussed herein may alsobe applicable in other medical techniques, such as any medical techniqueutilizing an endoscope.

Reference will now be made in detail to examples of the presentdisclosure described above and illustrated in the accompanying drawings.Wherever possible, the same reference numbers will be used throughoutthe drawings to refer to the same or like parts.

The terms “proximal” and “distal” are used herein to refer to therelative positions of the components of an exemplary medical device orinsertion device. When used herein, “proximal” refers to a positionrelatively closer to the exterior of the body or closer to an operatorusing the medical device or insertion device. In contrast, “distal”refers to a position relatively further away from the operator using themedical device or insertion device, or closer to the interior of thebody.

Both the foregoing general description and the following detaileddescription are exemplary and explanatory only and are not restrictiveof the features, as claimed. As used herein, the terms “comprises,”“comprising,” or other variations thereof, are intended to cover anon-exclusive inclusion such that a process, method, article, orapparatus that comprises a list of elements does not include only thoseelements, but may include other elements not expressly listed orinherent to such a process, method, article, or apparatus. Additionally,the term “exemplary” is used herein in the sense of “example,” ratherthan “ideal.” As used herein, the terms “about,” “substantially,” and“approximately,” indicate a range of values within +/−5% of a statedvalue.

FIG. 1 illustrates a medical system 100 that includes a medical devicesuch as an endoscope or other medical imaging device/medical device 105,a network 110, user device(s) 115 that may include display(s) 120 thatmay be viewed by a user/practitioner/physician/patient 125, andserver(s) 130 that may comprise a frame processor 135 that may executetechniques discussed herein. The endoscope 105, user device(s) 115,and/or server 130 may be wire connected (as shown), wirelesslyconnected, or otherwise communicatively coupled. Alternatively,functionality of the server 130 may be performed on endoscope 105, userdevice 115, etc. The server 130, endoscope 105, and/or user device 115may further comprise a single electronic device.

As shown in FIG. 1, endoscope 105 may be an insertion device such as,for example, a ureteroscope (e.g., LithoVue™ Digital FlexibleUreteroscope by Boston Scientific Corp.). With endoscope 105 positionedwithin a patient, for example, through the patient's urethra to apatient's kidney, a retrieval device (not shown) may be inserted toretrieve and remove material such as, for example, a kidney stone, withor without using laser lithotripsy. The endoscope 105 may record and/ortransmit image and/or video data when inserted into a patient, and mayhave a light or other imaging source that may act to display images ofthe interior of a patient's vessels, organs, etc. A fiber optic cable orother light source may illuminate the interior of the patient. Theendoscope 105 may be equipped with or receive a laser that may projectat a lower power setting, such that it acts as an aiming beam. Theaiming beam may act to inform the user of the endoscope where the laseris aiming, without illuminating at a high enough intensity to destroytissue or the kidney stone. The laser may also, per signal from theuser, emit electromagnetic waves at a higher intensity for performanceof laser lithotripsy, which may be used to remove, break up, orotherwise destroy one or more organ obstructions, such as kidney stones.

Display 120 may be a single, or at least a dual display, with eithermultiple screens or multiple displays on one screen. In one example, oneof the displays may show an image or images currently or previouslyobtained by endoscope 105. The other display may show an image or videoobtained from one or more additional imaging devices 145, such as byX-ray, Magnetic Resonance Imaging, Computerized Tomography Scan,rotational angiography, ultrasound, or another appropriate internalimaging device. Alternatively, one of the displays 120 may show an imagemodified using one or more image enhancement techniques discussedherein, while another may display an unenhanced image. Alternatively,one of the displays 120 may show an image modified using one or moreenhancement techniques discussed herein, while another of the displays120 may show an image modified using one or more different enhancementtechniques discussed herein.

The software or applications may manipulate, process, and interpretreceived images from imaging device 145 to identify the location, size,and characteristics of the aiming beam, kidney stone, or other material.As will be discussed further herein, the frame processor 135 may processand enhance received images from endoscope 105.

The physician may insert endoscope 105 into a patient when performing amedical procedure such as a lithotripsy to remove a kidney stone. Thedisplay 120 may become partially or completely obscured by pieces ofkidney stone or other floating particulate matter, for example, whenilluminated by a light on the endoscope 105. Pieces of the kidney stonemay need to be removed via the exit channel used by the endoscope 105(the access sheath, ureter, etc.). However, it may be difficult for thephysician 125 to ascertain whether the kidney stone is too large to fitout the exit channel, and whether it should be broken up further inorder to fit out the exit channel. The physician may attempt to removethe kidney stone in question via the exit channel, but the sharpness ofthe stone may cause tissue damage if it is too large, which may injurethe patient, increase recovery time, etc. Techniques are needed to moreeffectively identify whether a kidney stone will fit out the exitchannel.

FIG. 2 is a flow diagram of an exemplary method for processing medicalimages, according to aspects of the present disclosure. A source ofvideo or image frames 205, which may be any medical device, such as anendoscope 105 or imaging device 145, may provide frames to signal in210. The frames may be provided to a frame handler 215, which may storea plurality of frames. One or more frames 220 may be provided to a frameprocessor 135, which may produce one or more processed frames 230 viatechniques discussed herein. The processed frames 230 may be provided tothe signal out 235, which may be shown on display 120.

The signal in 210 may be a software handler that may transmit that a newframe has been received. The frame handler 215 may either directly senda frame via the signal out 235 to a display 120, or it may send one ormore frames to the frame processor 135. As will be discussed elsewhereherein, the frame processor 135 may perform object size determinationtechniques. The frame handler 215 may also send the original frame tothe display 120, and also send a copy of the frame to the frameprocessor 135. The processed frame 230 may be received and alsoforwarded to the display 120. This may allow for the original frame tobe displayed alongside the processed frame 230 at the display 120.Alternatively, the frame handler 215 may send the source frame 220 tothe frame processor 135, and the frame processor may return a processedframe 230 that comprises a dual display of the original and enhancedframe. Accordingly, the processed frame 230 may be larger than thesource frame. The frame processor 135 may further add buttons or otheruser interface elements to the processed frame 230.

Although techniques discussed herein are discussed as happening on theframe processor 135, which may be depicted as being located on a singledevice, any of the functions of the frame processor may be spread acrossany number of devices, for example, any of the devices depicted insystem 100. Further, one or more of the signal in 210, frame handler215, and/or signal out 235 may be housed on one or more servers 130, orany of the other devices pictured on system 100.

FIG. 3 is a flow diagram of an exemplary method for processing medicalimages to determine the size of objects, according to aspects of thepresent disclosure. A plurality of frames 304 may be received from aframe source. The frame source may comprise an endoscope 105 or othermedical imaging device 145. One or more frames 304 may be accumulated ata frame buffer. A frame may comprise an image of a kidney stone 308, orother object. While the kidney stone 308 may be illuminated by a lightsource on the tip of the endoscope or other medical device 105, such asby an optical fiber emitting white light, a laser beam 316, or otherelectromagnetic beam, may also be present and allow for aiming the tipof the endoscope, either for purposes of retrieving the kidney stone orperforming lithotripsy, etc. The beam 316, when illuminated, may cause ahalo 312 to be visible around the beam, which may be due to theintensity of the laser. Steps may then be taken to determine the size ofthe beam 316.

The halo 312 may be distinguished from the beam 316. As lasers aretypically a particular color, such as red, in the blue or green“non-matching” channels 322 there may be no trace or faint trace of thebeam 316, and no trace of the halo 312. Conversely, in the “matching”red channel 326, the laser and the halo 312 might appear together as alarge, bright, and indistinguishable entity. Similarly, a green laserand its halo might show up as a single bright indistinguishable entityin the green color channel, while at least the lower-intensity halowould not show up in the red channel or blue channel, etc. Thus, thecolor of the laser may be initially determined for purposes ofseparating color channels and performing techniques discussed herein. Inaddition, the endoscope may have a white light from an optical cable tohelp the user navigate. The white light may create reflections thatmight be confused by the algorithm as the aiming beam. By finding theaiming beam by comparing different color channels, this problem isavoided. A white light would show up equally in different colorchannels. A colored laser, or at least the halo, may show up primarilyin the corresponding color channel.

The aiming beam may be intense in all color channels, even though theaiming beam may be a laser of a particular color. This may makedistinguishing the aiming beam from other light reflections, for examplea light reflection from an LED on the endoscope, difficult. However, theaiming beam may have an associated halo around it, which may allow fordifferentiation of the aiming beam from other light sources orreflections. In addition, the halo may only appear in a particular colorchannel, for example the channel of the color of the laser. Thus, thehalo may be reliably identified by comparing different color channels.Once the beam of matching channel 326 (e.g. red channel for a red laser)and smaller beam 322 of the non-matching channel (green and/or bluechannels for a red laser) 322 are determined, the two channels may becombined to form a mask area in order to more accurately determine thehalo. This may be done by subtracting the non-matching channel 322 fromthe matching channel 326, which may produce an image of the halo withthe beam 316 removed at 329. Alternatively, one of the channels may beinverted at 327 to form an inverted channel 328. The inverted channel328 may be added to the, e.g., non-matching channel to form the halo329. A bounding box or other boundary may be placed around the halo/maskarea 330 for further image analysis.

After the bounding box 330 is determined, the aiming beam 339 in thecenter of the halo and within the bounding box may be determined. Imageartifacts 340 may also be present. The artifacts 340 may show up, forexample, if the laser reflects off of objects near the aiming beamitself. The algorithm, by comparing the various candidate aiming beams,may consider the largest object to be the true aiming beam 339, and maydiscard or disregard the artifacts 340. The edges of the true aimingbeam 339 may be determined using an algorithm such as Canny edgedetection, Hough transform, etc. The algorithm may then approximate thetrue shape and size of the aiming beam 339 by placing a circle orellipse around the aiming beam to form an aiming beam ellipse 342. Thismay be done dynamically, or the shape of the aiming beam may bepreviously known. This ellipse placement may be performed based on thedetermined aiming beam edges. Multiple candidate ellipses may be fitover the detected edges, and the best-fitting ellipse may be determined,e.g. the aiming beam ellipse 342. Metrics may be determined for theaiming beam ellipse 342, such as the measurements of the major and minoraxes.

The aiming beam may be of a standard, predetermined size and shape.Since the aiming beam 316 is a laser or other highly directional orunidirectional electromagnetic light source, it does not getsubstantially larger with distance. Hence, whatever object upon whichthe aiming beam is projected may be measured by using the aiming beamand/or its halo as a standard metric. Thus, kidney stones or otherobjects may be measured by evaluating the aiming beam and/or halo.However, difficulties may arise that may complicate an accuratemeasurement. Kidney stones are often jagged and contain crevices orother irregularities that distort the apparent shape of the aiming beam.Thus, the aiming beam may appear abnormally small or abnormally large,which may cause incorrect estimates of the size of any object beingmeasured based on the aiming beam.

To mitigate this problem, the image of surface upon which the aimingbeam is being aimed may be evaluated by image analysis within thebounding box, or otherwise within a predetermined distance of the aimingbeam 316 and/or halo 312, may be extracted at 334. The image featuresmay comprise image lighting, texture, entropy, artifact detection, etc.The extracted image features plus the major and minor axes of theellipse 342 may be provided to a trained machine-learning system, whichmay apply weights to alter the estimated size of the aiming beam 316and/or halo 312.

The machine learning system may be trained. A size (e.g., in pixels) ofa ground truth indicator may be determined. The ground truth indicatormay be a physically drawn circle or other shape onto an image of thekidney stone representing the true size of aiming beam. In the trainingprocess, the size of the physically drawn circle will be extracted fromthe image. A correlation between the size of the ground truth indicatorand the aiming beam properties (major and minor axes of ellipse 342,image lighting, texture, entropy, artifact detection, etc.) may bedetermined. In the inference step of the production version, the machinelearning model may calculate the size of the aiming beam. This may beaccurately performed despite distortions produced by the surface uponwhich the aiming beam is being projected.

As discussed above, the dimensions of the aiming beam may be known. Forexample, the aiming beam may be a laser that, when shined on a surface,creates a “dot” 5 mm across. As the laser is a directional beam, the dotmay be 5 mm across no matter how far away the object is upon which thedot is being shined. Thus, based on the final estimated shape and/orsize of the aiming beam, measurements of the surface on which the aimingbeam is projected may be determined. This may be done by assessing thesize of an object relative to the known size of the laser dot. Forexample, if a laser dot is known to be 5 mm across, and the kidney stoneupon which it is shined is approximately double the width of the laserdot, the kidney stone may be determined to be 10 mm across.

Using this same technique, the size of the exit channel may bedetermined and displayed to the user 125. Thus, using this scalingtechnique, the size of objects may be determined, and the accurate sizeof projected virtual objects may also be determined. A visual indicator350 representing the size of the exit channel relative to the surfaceupon which the aiming beam is projected may be displayed on the display.The user 125 may thus be able to determine if the kidney stone or otherobject, upon which the aiming beam is shined, will fit out the exitchannel visually and with minimal cognitive load. Alternatively or inaddition, one or more rulers may be displayed, such as rulers 354 alongthe X or Y axis. Visual indicators of the bounding box 330 and/or finalaiming beam ellipse 342 may also be displayed on a display to the user125.

FIG. 4 is a flow diagram of an exemplary method for determining medicalimage enhancement, according to techniques discussed herein. At step405, an image frame from the medical device may be received, and at step410 a first color channel and a second color channel in the image framemay be determined. At step 415 a location of an electromagnetic beamhalo may be identified by comparing the first color channel and secondcolor channel. At step 420, edges of an electromagnetic beam may bedetermined based on the electromagnetic beam halo, and at step 425 sizemetrics of the electromagnetic beam may be determined based on the edgesof the electromagnetic beam. At step 430 a visual indicator or otherprojection on the image frame may be displayed based on the size metricsof the electromagnetic beam. As discussed elsewhere herein, the visualindicator may comprise a visual representation of the exit channel, aruler, a bounding box, an electromagnetic beam halo, and/or anelectromagnetic beam.

FIG. 5 illustrates an exemplary system that may be used in accordancewith techniques discussed in FIGS. 1-4, according to aspects of thepresent disclosure. FIG. 5 is a simplified functional block diagram of acomputer that may be configured as server 130, endoscope 105, imagingdevice 145, and/or user device 115, according to exemplary embodimentsof the present disclosure. Specifically, in one embodiment, any of theuser devices, servers, etc., discussed herein may be an assembly ofhardware 500 including, for example, a data communication interface 520for packet data communication. The platform also may include a centralprocessing unit (“CPU”) 502, in the form of one or more processors, forexecuting program instructions. The platform may include an internalcommunication bus 508, and a storage unit 506 (such as ROM, HDD, SDD,etc.) that may store data on a computer readable medium 522, althoughthe system 500 may receive programming and data via networkcommunications. The system 500 may also have a memory 504 (such as RAM)storing instructions 524 for executing techniques presented herein,although the instructions 524 may be stored temporarily or permanentlywithin other modules of system 500 (e.g., processor 502 and/or computerreadable medium 522). The system 500 also may include input and outputports 512 and/or a display 510 to connect with input and output devicessuch as keyboards, mice, touchscreens, monitors, displays, etc. Thevarious system functions may be implemented in a distributed fashion ona number of similar platforms, to distribute the processing load.Alternatively, the systems may be implemented by appropriate programmingof one computer hardware platform.

The disclosed techniques may help enable efficient and effectiveprocedures to breakup and/or remove material from a patient's organ. Inparticular, the user may easily view the processed frames to assistwith, for example, removing kidney stones within the patient's kidney

Moreover, while examples discussed in this disclosure are commonlydirected to ureteroscopic kidney stone removal, with or withoutlithotripsy, it is further contemplated that the systems and proceduresdiscussed herein may be equally applicable to other material removalprocedures. For example, the systems and methods discussed above may beused during a percutaneous nephrolithotomy/nephrolithotripsy (PCNL) toplan for a procedure and mid-procedure to locate any missed kidneystones. The systems and methods discussed above may also be used to planfor or conduct procedures to remove ureteral stones, gallstones, bileduct stones, etc.

While principles of the present disclosure are described herein withreference to illustrative examples for particular applications, itshould be understood that the disclosure is not limited thereto. Thosehaving ordinary skill in the art and access to the teachings providedherein will recognize additional modifications, applications,embodiments, and substitution of equivalents all fall within the scopeof the features described herein. Accordingly, the claimed features arenot to be considered as limited by the foregoing description.

We claim:
 1. A system for processing electronic images from a medicaldevice, comprising: at least one data storage device storinginstructions for processing electronic images; and at least oneprocessor configured to execute the instructions to perform operationsfor processing electronic images, the operations comprising: receivingan image frame from the medical device; determining a first colorchannel and a second color channel in the image frame; identifying alocation of an electromagnetic beam halo by comparing the first colorchannel and second color channel; determining edges of anelectromagnetic beam based on the electromagnetic beam halo; determiningsize metrics of the electromagnetic beam based on the edges of theelectromagnetic beam; and displaying a visual indicator on the imageframe based on the size metrics of the electromagnetic beam.
 2. Thesystem of claim 1, the operations further comprising: extractingfeatures from the image frame within a predetermined distance of theelectromagnetic beam and/or electromagnetic beam halo; and determining asize of the visual indicator on the image frame based on the extractedfeatures.
 3. The system of claim 2, wherein the size of the visualindicator on the image is determined based on a weighting of each of theextracted features.
 4. The system of claim 1, wherein the visualindicator on the image frame corresponds to a size of an exit channelthrough which objects are passed.
 5. The system of claim 1, whereincomparing the first color channel and the second color channel furthercomprises: determining that the first color channel depicts theelectromagnetic beam and the electromagnetic beam halo; determining thatthe second color channel depicts the electromagnetic beam; andsubtracting, or adding the inverse of, the second color channel and thefirst color channel to identify the location of an electromagnetic beamhalo.
 6. The system of claim 1, wherein determining the edges of theelectromagnetic beam comprises: determining an approximatedelectromagnetic beam based on the electromagnetic beam halo;distinguishing the approximated electromagnetic beam from imageartifacts based on the size of the approximated electromagnetic beamrelative to the image artifacts; and fitting a circle or an ellipse tothe approximated electromagnetic beam.
 7. The system of claim 1, whereinthe first color channel is determined so as to match a predeterminedcolor of the electromagnetic beam, and wherein the second color channelis determined so as to not match the predetermined color of theelectromagnetic beam.
 8. The system of claim 1, wherein theelectromagnetic beam is a laser.
 9. The system of claim 1, wherein thesize metrics correspond to a diameter or radius of the electromagneticbeam.
 10. A method for processing electronic images from a medicaldevice, comprising: receiving an image frame from the medical device;determining a first color channel and a second color channel in theimage frame; identifying a location of an electromagnetic beam halo bycomparing the first color channel and second color channel; determiningedges of an electromagnetic beam based on the electromagnetic beam halo;determining size metrics of the electromagnetic beam based on the edgesof the electromagnetic beam; and displaying a visual indicator on theimage frame based on the size metrics of the electromagnetic beam. 11.The method of claim 10, further comprising: extracting features from theimage frame within a predetermined distance of the electromagnetic beamand/or electromagnetic beam halo; and determining a size of the visualindicator on the image frame based on the extracted features.
 12. Themethod of claim 11, wherein the size of the visual indicator on theimage is determined based on a weighting of each of the extractedfeatures.
 13. The method of claim 10, wherein the visual indicator onthe image frame corresponds to a size of an exit channel through whichobjects are passed.
 14. The method of claim 10, wherein comparing thefirst color channel and the second color channel further comprises:determining that the first color channel depicts the electromagneticbeam and the electromagnetic beam halo; determining that the secondcolor channel depicts the electromagnetic beam; and subtracting, oradding the inverse of, the second color channel and the first colorchannel to identify the location of an electromagnetic beam halo. 15.The method of claim 10, wherein determining the edges of theelectromagnetic beam comprises: determining an approximatedelectromagnetic beam based on the electromagnetic beam halo;distinguishing the approximated electromagnetic beam from imageartifacts based on the size of the approximated electromagnetic beamrelative to the image artifacts; and fitting a circle or an ellipse tothe approximated electromagnetic beam.
 16. The method of claim 10,wherein the first color channel is determined so as to match apredetermined color of the electromagnetic beam, and wherein the secondcolor channel is determined so as to not match the predetermined colorof the electromagnetic beam.
 17. The method of claim 10, wherein theelectromagnetic beam is a laser.
 18. The method of claim 10, wherein thesize metrics correspond to a diameter or radius of the electromagneticbeam.
 19. A non-transitory computer-readable medium storing instructionsthat, when executed by a computer, cause the computer to performoperations for processing electronic images from a medical device, theoperations including: receiving an image frame from the medical device;identifying a location of an electromagnetic beam shined upon a surfacein the image frame; analyzing the electromagnetic beam to determine sizemetrics of the surface upon which the electromagnetic beam is shined;and displaying a visual indicator on the image frame based on the sizemetrics of the electromagnetic beam.
 20. The computer-readable medium ofclaim 19, wherein analyzing the electromagnetic beam to determine sizemetrics further comprises: determining a first color channel and asecond color channel in the image frame; identifying a location of anelectromagnetic beam halo by comparing the first color channel andsecond color channel; determining edges of an electromagnetic beam basedon the electromagnetic beam halo; and determining size metrics of theelectromagnetic beam based on the edges of the electromagnetic beam.